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1. INTRODUCTION 

The worldwide community, Governments and industries all around the world have recognized the 
danger of global warming and are increasingly trying to find alternatives to minimize the greenhouse 
emissions from fossil fuels. In fact, renewable energy is a promising solution to reduce greenhouse emissions 
and the use of renewable energy sources presents a tremendous potential for many applications and 
especially off-grid stand-alone systems [1]. Powering remote sites with renewable sources require the use of 
storage devices due to the fluctuating nature of the power production. In this paper, we will propose a system 
titled a hybrid renewable energy system (HRES), since it associates at least two renewable energy sources 
and a storage element. Many types of renewable energy resources such as wind and solar energy come either 
directly or indirectly from the sun [2]. A system combining different types of renewable energies is called a 
hybrid renewable energy system (HRES). Between all existing renewable sources of energy, solar and wind 
energies are the most commonly used in HRES along with storage units such as batteries to store the excess 
of energy provided by the input sources [3]. A comparison between different storage units were done in [4] 
and it was found that batteries are the most appropriate storage units used in HRES. Energy management for 
HRES was done before using fuzzy logic [5-6], neural network detailed in [7] and genetic algorithm in [8]. 
The results obtained after applying the fuzzy modeling showed good estimation of the PV and WT powers 
and the proposed method in [8] has been applied to the analysis of a hybrid system which supplies power for 
a telecommunication relay station, and good optimization performance has been found. 
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To resolve this problem in an open dynamic modern electric power system, recent trends for 
controlling and monitoring HRES operations are moving towards the application of auto- mated agent 
technology usually called multi agent structures. MAS is an important branch of distributed artificial 
intelligence [9-10]. MAS can decompose a complicated system into several agents and the collaboration 
of these agents can solve various system difficulties and limitations. Multi- agent structures, consist of 
various independent agents with local information and limited abilities, which are capable of interacting 
with each other in order to achieve a targeted objective. The inclusion of artificial intelligence and expert 
system in MAS structure are the additional merits in the design of hybrid controllers in the hybrid system. 
They facilitate reliability of the system and perform accurate predictions. 

Multi-agent technology is not only a subfield of distributed artificial intelligence but also a highly 
associative research field including economics, philosophy, bionomics and sociology etc. it is a technology 
where the agent’s correspondence, collaboration and intercommunication are used to achieve a distributed 
and complicated tasks [11]. MAS and the autonomous agents provide a new method to analyze, design and 
implement sophisticated applications since they are part of the distributed artificial intelligence domain and 
they benefit as well from other disciplines such as cognitive sciences, sociology, and social psychology. MAS 
can optimize a system and enhance its stability and intelligence. It is used widely in many application 
domains to address various problems quickly: 

— Industry: The automation of the process and of the production, logistics, the co-operative robots, the 
Smart Home [12]. 

— Communication (including Telecommunications): The management of networks, electronic 
commerce [13]. 

— Information: The personal assistance, the search for information, the management of the workflow, the 
Smart Home [14]. 

— Health: The supervision of the sick, the systems of support [15]. 

— Transportation, logistics: the support of the mobility, the information of the trip [16] 

It is used as well to address energy application such as the purchase of the power to support of a 
crisis center as mentioned in [17]. It is also used in multiple engineering power system applications, such as 
smart grids [18] and smart homes [19]. The simulation results of smart grids indicate that the proposed multi- 
agent system can facilitate the seamless transition from grid connected to an island mode when up- stream 
outages are detected. Authors in [19] show how to reduce problem complexity by dividing the whole 
problem into independent sub- problems. This denotes the capability of a multi-agent system as a technology 
for managing the smart grid/home operation. In [20], MAS was applied in service restoration and results 
have concluded that this method is able to reach sub- optimal target configurations, which are favorably 
com- pared with those obtained by a mathematical programming approach. A cooperative Multi-agent 
framework for self-healing mechanisms distribution systems was adopted in [21] and the results of the 
simulation conducted using the new framework demonstrate the effectiveness of the proposed control 
structure. In this paper, a power generation system based on multi- agent technology is proposed to 
manage the energy of an HRES composed of wind and solar energies along with batteries as storage units 
that will be able to satisfy the load demand for an isolated site. The key motivation for proposing a MAS 
lies in its inherent benefits such as flexibility, scalability, autonomy to solve complex problem which cannot 
be solved by conventional control theory. The agents interact between them to collaborate, cooperate and 
coordinate actions. The paper is structured as follows: the second section introduces principles of multi- 
agent approaches. The third section de- scribes the hybrid renewable energy system adopted in this 
research. The fourth section presents the architecture of the energy management system. The fifth 
section explains multi- agent architecture. The sixth section discusses the results found and finally, a 
conclusion summarizes the results and presents some perspectives. 


2. MULTI-AGENT APPROACH 

Due to their complexities and geographical distribution, HRES cannot be easily managed 
by centralized systems. Intelligent integrated systems must manage the production of renewable energies 
or help reduce the consumption of the various users of the network. Distributed artificial intelligence and 
more particularly multi-agent systems appear as an adequate means of solving problems related to 
autonomous systems. An agent is all that can be seen as perceiving its environment by means of sensors and 
acting on this environment using effectors autonomously. This definition gives a very general overview on 
the definition of agents. In [22], Wooldridge and Jennings define an agent as a system, software or not, 
with the following properties: 
— Autonomy: An agent must operate without direct intervention from the outside and have some control 

over his actions and internal states. 
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— Social skills: Agents interact with each other through a language. 

— Reactivity: Agents perceive their environment and respond in a timely manner to the changes occurring 
in it. 

—  Proactivity: Agents not only respond to changes in the environment, they can also behave in a way that 
allows them to act on their own to meet their goals. Finally, Ferber extends these definitions to highlight 
the importance of the environment. 

For Ferber [23], the agent is a physical or virtual entity: 

— Able to act in an environment. 

— Can communicate directly with other agents. 

— Owns its own resources. 

— Able to perceive his environment (but in a limited way). 

— Tends to meet its objectives, taking into account the resources and skills at its disposal, and according to 
its perception, representations and the communications it receives. 


3. HYBRID RENEWABLE ENERGY SYSTEM ADOPTED 

The HRES used in this research is a stand-alone hybrid PV/Wind/Battery system that should supply 
the electricity to a private house or an apartment in an isolated site. Solar and wind energies were combined 
in this system as they have the advantage of complementing each other. To implement an HRES on an 
isolated site, a study was done to be able to determine the required input and output sources required for the 
system to satisfy a load demand besides the changeable weather conditions: the system requires a 
combination in series of 16 PV panels composed of 36 cells to provide 1K Wc of maximum energy per day, 
along with a generic wind turbine with a rated power 1KW peak under STC conditions (Temperature 25C 
and lighting 300 W/m2). The maximum power delivered by the system is 2KW. The system also includes a 
number of batteries to either store the excess of energy generated by the sources or provide the energy 
demanded by the load when there is low renewable energy produced [24]. The Figures 1-6 shows the HRES 
used in this research: 


4. ARCHITECTURE OF THE ENERGY MANAGEMENT SYSTEM 
4.1. Structure of the studied system 
The hybrid system used in this paper is composed of: 

— A wind turbine a wind turbine connected to the DC bus using static converters. 

— Photovoltaic panels Photovoltaic (PV) panels connected to the DC bus using static converters. 

— Storage units in a HRES, the energies produced by the wind turbines and the PV panels are used to 
satisfy the load demand for the site. In such systems. Storage units are essential to meet the shortage of 
renewable energy which are unpredictable by nature. A storage system makes it possible to store the 
surplus of the energy produced or to supplement the energy required in the case of insufficient energy 
production. For the system proposed in this paper, two batteries with a 12V voltage and 200Ah as 
maximum batteries capacity were used as storage units. 
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Figure 1. Hybrid renewable energy system 
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Figure 2. Structure of the wind turbine energy 


production system Figure 3. Structure of the photovoltaic energy 


production system 


4.2. System operation 

The system power (Psys) is calculated from the power generated by the PV panels (Ppv) 
and the power generated by the Wind turbine (Pw) at each period of time (t). Psys is obtained by the 
following formula: 


Psys(t) = Ppv(t)+Pw(t) (1) 
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Figure 4. Wind turbine fluctuation Figure 5. PV panels power fluctuation 


Figure 6. Daily load demand variation 


To maintain a longer life time for batteries, the batteries state of charge (SOC) should remain between 
30% and 80%. The SOC represents the second parameter and is calculated at each period of time t (1 hour) 
by the following formula: 


SOC =P bat/BC (2) 


Where BC is the battery capacity and Pbat is the battery power calculated. The battery level 
(SOC) should be maintained between SOCmin and SOCmax where: SOCmin = 30% (the battery cannot 
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be discharged if it is at its minimum level) SOCmax = 80% (the battery cannot be charged if it is at its 
maximum level) the maximum and minimum level of the batteries is calculated then as follows: 


Pbmin = SOCmin * BC (3) 
P bmax = SOCmax * BC (4) 


The load demand (Pload) for Figure 7 represents the site. The third parameter considered is NewBat, 
which shows the battery level, NewBat is calculated at each period by the following formula: 


NewBat = Batterie +P pv +P w —P load (5) 
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Figure 7. Flowchart of the optimal energy management 


5. MULTI-AGENT ARCHITECTURE 

The goal of this work is to propose and develop an agent-based system to intelligently manage the 
distribution of power demand in a hybrid system. Modeling the sources of production by a multi-agent 
system makes it possible to form an intelligent system of power. Indeed, every important element in the 
system is represented by an autonomous agent. The idea is to take advantage of multi-agent systems. 
Different types of agents for reinforcement learning are designed. Thus, a distributed intelligence can be 
more efficient than a centralized intelligence. This system has the advantage of knowing, at all times, 
the current states of wind turbines and PV panels making it possible to apply quickly and reliably the control 
laws to various components. Agents interact with each other to collaborate, cooperate, and coordinate actions. 
This structure distributes the treatments on the various agents whose objective is to reduce the complexity 
and to improve the speed of response to requests. Thus, the system has the advantage of being adaptive and 
scalable because it increases particularly the flexibility of the adjustment facing the connection or the 
disconnection of wind/PV panels sources of production. Figure 8 shows multi-agent structure, Figure 9 
shows multi-agent modelling. 


IJ-AI Vol. 8, No. 4, December 2019: 352 — 359 


IJ-AI ISSN: 2252-8938 Oo 357 


The proposed multi-agent structure is composed of a cognitive agent called “Supervisor Agent”, 

several other cognitive agents, each called “WT Agent”, “PV Agent”, “Load Agent” and” Battery Agent”. 

a. Supervisory Agent: This is a unifying agent allowing: 

— Receive and calculate the sum of the powers generated by turbine and PV panels. 

— Receive the requests from the consumer agent. 

— Store the remaining energy in the battery agent. 

— Communicate with the turbine and PV panels agent to ensure the supply of the requested power. 

— Take the necessary decisions in case a turbine and PV panels agent is not able to provide the power. 

b. WT Agent/PV Agent: the role of each WT/PV is: 

— Calculate the power produced by the WT/PV. 

— Communicate with the supervisor agent to respond to mpotential demands. 

c. Load Agent: It is the executing agent on the consumer side. It is at the level of houses that have no 
source of energy specific to them and must refer to large generators to ensure their needs. The role of 
this agent is to communicate with a supervisor agent and ask how much energy to consume. 
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Figure 8. Proposed multi-agent structure 
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Figure 9. Sniffer diagram for multi-agent modelling 
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6. RESULTS AND DISCUSSIONS 

The multi-agent system was tested with batteries filled at their minimum level and other batteries 
filled to their maximum level as follows: 

Empty batteries: where the battery starts with its lowest value (Pbat = Pbmin = 1200W). The 
variation of the batteries level for one day is represented by the graph below: Full batteries: where the 
battery starts with its maximum value (Pbat = Pbmax = 3200W). The variation of the batteries level for 
one day as shown in Figure 10. 
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Figure 10. Battery power curve obtained from the multi-agent in case of a system starting 
with an empty battery 


Figure 11 shows that the batteries level started with its maximum level (3200W). 
Then it was discharged until the minimum level (1200W) was reached. The batteries then remained constant 
at their minimum until they were charged again. Once the batteries level reached their maximum, 
it remained constant. As it is shown from the charts above, the batteries level varies during the day 
(charging or discharging) while it remains between its minimum and maximum values: 
Pbmin=1200W and Pbmax=3200W. 


Figure 11. Battery power curve obtained from the multi-agent in case of a system starting 
with a full battery 


7. CONCLUSION 

In this paper, multi agent system technology is introduced into power systems, and applied in a 
stand-alone system by collaborating multi-agents in wind-solar hybrid energy system. The multi-agent system 
approach and the agent’s behaviors can share information and knowledge and enhance single agents ability 
by communicating among themselves. The system behavior has been observed through a simulation model 
and it has been demonstrated that the proposed energy management system was able to adapt its response 
even when the configurations change. As future work, a comparison study will be done between the energy 
management using fuzzy logic control and the MAS. On the other hand, this work can be improved by 
increasing the number of agents and performing more testing on the performance of the proposed approach. 
Learning also can be enhanced by using other intelligent methods like neural networks and Q-learning. 
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The aim of these improvements is to make the different sources of production smarter in order to improve 
response times and avoid unnecessary shutdowns of the system. 
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